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(57) ABSTRACT 

Systems and methods for providing an enhanced auditory 
behavior to a graphical user interface arc de.«;cribed. Control 
elements portrayed by the graphical user interface on a 
display are associated with at least two states. When tran- 
sitioning between stales, a sound c fleet specified for that 
transition can be provided to provide further user or designer 
customization of the interface appearance. Movement of 
objects can be accompanied by a repeated sound effect. 
Characteristics of i>oth sound e fleets can be easily adjusted 
in volume, pitch and frequency. 
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(;i<AI»HICAL USKR INTI^RFACE HAVING compuler by, for example, moving objccls on (he desktop, 

SOUND KKKECTS FOR OPERATING choosing commands from menus, and manipulating window 

CONTROL IU>:MENTS AND DI^GCING control elements, such as checkboxes and scroll bars. An 

OliJKCrS exemplary desktop screen is reproduced as FIG. I. Therein, 

S various GUI objccls including windows and icons arc 

RLLArUD AIM^LICATIONS depicted. 
'Ihis application is related to U.S. patent application Ser. . ^imiows arc one example of GUI objects which can be 

No. 08/^3,327 entitled "A System and Method for Cus- ^'^^"f '"'^^ '^»^^P^; color. Some stand a rxi types of 

■ ■ A I 11 u/.,:«.„f r-...«k;^oi ii.-r i«t..r windows are commonly predchned lor the interface 

tomi/jHK Appearance and Behavior ol Uraphical User Inter- , ... i j- i 

M . / ,,o * . r c , nu/^/m^Q mcluding, for example, a document window and a dialog 

laces and to U.S. patent apphcadon Ser. No. 08/243,268 , > . i < r i i • i ■ 

.-.1 ^ MO . u- n . A xK^r^oc- l^ux. One exarnp e of a standard for a document window is 

enti ed Switching Between Appcarance/I3cnavior Incmcs ... . , , . , . . « - j u l 

y u- 1 It t * f » i« II c „...^,,t ,,^i.v*i;^„ illustrated in MG. 2. Lach document window which con- 

in Graphica User Interfaces, and to U.S. patent application . l- , . , ^ .-.i i -.u . m i 

o Ki /.oyo^'i .1^1 .M j »» ™ 1 AKo.„,..;«« forms lo this standard has a lille bar with a title drawn in a 

Ser No. 08/242,963 entitled Pattern and Color Abstraction ^ , r j r . , i a.- i . a 

n u - t I I 1 . r »» .^r^u r.t*.^! ^« syslem-defined font and color. Active document windows 

in a Graphical User Interface, each ot which was tiled on , , . , , . n . i • i-i^ ^ r 

KA w ,n,,A * u f u- u ;o •« ^.,^r«i„,» t;an also have mntrol elements as illu.sirated in \ \G. 2, for 
May 16, 1994 and each of which is incorporated here by , , . i • • j .. 

*• . ,. *. r„iai«/t^ i?c .^o(^«t examplc, a close box, a /x)om box, a size box, and scroll 

reference. Inis application is also related lo U.S. patent . » ' . , , . . u . • n.- ^ ■ i i 

. *' fioMicauT ^^fiii 1 iK-.r bars. Other control elements not shown in MG. 2, include 

application Ser. No. 08/435,387, entitled Graphical User j u i . ^^, i n i • .i 

f A . . I ri ^„to" r.i,»ri buttons, menu Items and checkboxes. iTiosc skilled in the art 

ntcrfaces I aving Animated Control Llcments , lilcd on •,, • .u . • i .u i i . i 

c ,oi.c .1 1- 1 *■ u-^k-.- »j K k.. will recogni/e that myriad Other control elements are known 

May 5, 1995, the disclosure ol which is incorporated here by , . ^ ^ 

/ ^ 20 and in use. 

reference. 

Control elements are on-screen objects that a user can 

COPYRIGHT NOnClI manipulate with, for example, a mouse to cause an imme- 
diate action or modify settings to cause a future action. I'or 

A portion of the disclosure of this patent document example, a button control element can provide for the 
contains material which is subject to copyright protection. 25 u^er interface to receive user input as to a selected 

The copyright owner has no objection to the facsimile function to be performed by the system. I-IG. 3 illu.slrates a 

reproduction of the patent disclo.sure as it appears in the wind{)w entitled "Find" having three budon control elements 
Patent and Trademark Ofllce patent file or records, but t^^^^ describe the function to be performed when 

otherwi.se reserves all copyright rights whatsoever ^^^^ ^^^^^^^^^ elements are activated. A user can activate a 

UAr^i^r'Ufii iisin button control element in a variety of ways, for example by 

BACKCiKOUNU positioning a cursor (not .shown in TIG. 3) over the amtrol 

llie present invention relates generally lo graphical user element and providing an activating input, e.g., depressing a 

interfaces for computer systems. More particularly, the mouse button. 

present invention relates to sy.stcms and methods for inter- As shown in I-IG. 3, control elements arc typically 

facing applications and operating systems which provide for displayed in a static default or normal state. I lowcver, when 

added behavior, in the form {)f sound eficcts, over object a button control element is actuated the graphical user 

operation and movement in graphical user interfaces. interface redraws the control clement in a sea>nd static state 

Ihe evolution of the computer indu.stry is unparalleled in which visually informs the user thai the system has recog- 

its rate of growth and complexity. Personal computers, for ni/ed the user's input and is performing Ihe desired function, 

example, which began as little more lhan feeble calculators I'or example, some conventional graphical user interfaces 

Willi limited memory, tape-driven input and monochrome redraw button control elements in a depressed stale to 

displays arc now able (o tackle almost any data processing indicate activation. However, most software applications 

ta.sk. While this meteoric increase in power was almost provide little or no corresponding sound behavior lo accom- 

sufiicient to satisfy the demand of applicalit)n programmers pany the transition between stales, 

and end users alike, the corresponding increase in complex- Hie success of these type,s of conventional interfaces is 

ity created an ease-of-usc problem which the industry was evident from the numberofa>mpanies which have emulated 

somewhat slower in solving. Hius, designers were faced the desktop environment. Liven successful concepts, 

with a new challenge: lo harness this computing power in a however, must continually be improved in order to keep 
form usable liy even those with relatively lillle computer ^„ pace with the rapid growth in ihis industry. The advent of 

training lo smooth the iransilion of other industries into a multimedia, especially CD-ROM devices, has prt)vide<l vast 

compuler-ba.sed information. paradigm. quantities of secondary storage which have been used to 

As a result, in the early lo mid-198()\s many new I/O provide video capabilities, e.g., live animation and video 

philosc^phies. .such as "u.ser friendly," "WYSIWYCJ" and clips, as regular components of applicilions. With lhe.se new 
"menu driven" came to the forefront of the industry. 'Ihese ^s resources at their disposal, application tlesigners, and others, 

concepts are particularly applicable to microcomputers, also desire additional control over the appearance and lieliavior 

known as personal comj)ulers, which arc intended lo appeal of the display, including the desktop environment and, in 

t(» a britad audience of computer users, including lho.se who particular, objects and control elements on the desktop, 
pievitnisly feaied and mistruslcd computers. An important In the related application entitled "Graphical User Inter- 

a.^pcct tif ctimpulers which empkiy these concepts was, and faces Having Animated ('onlrol Llemenls", it has been 

continues lo be, the interface which a Hows the u.ser lo iiipul described how to provide additional control over the appear- 

commantls and data and receive results, which is commonly aiice of, for example, cimliol eiements by provitling ani- 

lefcrred Ut as a graphical u.ser interface (GUI). mated Iransilion elTects. Hie present invenliiui expands upon 

One type ttf GUI display is ba.sed on a visual metaphor these concepts by describing varitius techniques for ci eating 
which uses a monittir screen as a work surface called a fiS realistic sound elf eels which can be provided to support 

"desktop" where documents arc presented in relocatable t)hject actions and enhance the behavioruf the graphical user 

regions termed "windows". The user interacts with Ihe interface. 
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SUMMARY 

According lo exemplary cmboditncnLs of the present 
invention, improved behavioral characlcrislics can be pro- 
vided lo GUIs by providing sound elTccls associated with 
object operations. For example, one -shot sounds can be 
output when control elements are operated, e.g., a sound 
associated with actuating a button control clement. 'Ilie 
volume, pitch, delay and frequency of the sound cfiTcct can 
be varied cither randomly or by the theme designer. 

According to other exemplary enibudimenls of the present 
invention, a more a)mplicated sound effect can be provided 
for GUI operations which involve dragging an object, e.g.. 
an icon or a window, across the display. In these 
embodiments, a portion of the sound cficci is repealed to 
provide for a variable length .sound effect determined by the 
length of the drag operation. Panning can be incorj)oratcd by 
mixing stereo channels to provide an auditory effect of 
movement. 

BRim- nr^scuiPTioN oftmi- drawings 

Hie foregoing, and other, objects, features and advantages 
of the present invention will Ixj more readily understood by 
those skilled in the art upt)n reading the following detailed 
dc.scriptit)n in conjunction with the drawings in which: 

I'Kj. I shows a conventional desktop screen; 

FIG. 2 .shows a conventional document window; 

1*!G. 3 illustrates an exemplary window having button 
control elements; 

FKj. 4A illu.strates an exemplary computer system which 
can be u.scd in conjunction with the present invention; 

I'Kj. 4B is a block diagram iUnslraling various exemplary 
functional units of the ct)mputer system of l-IG. 4B; 

I'IG. 5 is a state diagram used lo illu.slrate .sound effect 
transitions of a control element according to an exemplary 
embodiment of the present invention; 

I'lG. 6 is an exemplary .state matrix used to describe 
control eicnient transitional sound effects according lo an 
exemplary embodiment of the present invention; 

I'IG. 6A depicts a .sequence of .sound etl'ecl reproduction 
involving an exemjilary tine-shot .sound ellcct and looping 
sound effect; 

I'Kj. 7 illu.slrates a drag operation wherein a looping 
.sound ell'ecl can be tiulput; 

FIG. K i.s a graph illustrating a p aiming function used lo 
vary sound effect volume belwcen speakers according to an 
exemplary embodiment of the present invention; and 

I'IG. 9 is a graph illustrating random frequency variation 
determination for sound effects according to exemplary 
embodiments of the present inventitin. 

DLTAILFI) DUSCKimON 

I he present invention is described herein by way of 
exemplary, illustrative embodiments, some of which u.se the 
Macinto.sli® computer system and visual chsplays created 
thereby as a reference for explaining the present invention. 
Those desiring additional information with respect to the 
Macintosh® system are referred to hviidc. Macintosh, Vtils. 
1 -fi. Of course, tho.se skilled in the art will readily appreciate 
llial systems and methods according to the present invention 
can he applied lo any type of display system having a user 
interface, l-urther, although certain operations as.socialcd 
with exemplary (.JUI olijects used in an operaiiftg system (as 
(ippo.sed lo applications running under the control of the 
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operating system) arc u.sed to describe concepts according lo 
the present invention, it will be understood that the sound 
effects described by the present invention are applicable to 
any type of manipulation of any type of interface object. 

5 Graphical u.scr interfaces according to the present inven- 
tion can, for example, be used in conjunction with a com- 
puter such as that illustrated in FIG. 4 A and in particular 
with operating sy.stcms u.sed to coordinate the operation of 
such computers. Tlicrein, a personal computer is illustrated 

1'^ as having a Ixjx 16 which contains, among other elements, 
circuit boards associated with the computer's functions 
including memory devices and one or more processors, a 
keyboani 18, a pointing device 20 and a monitor 22 having 
a display .space 24. 'I'he computer will also preferably 

1^ include at least two speakers 26 and 2N a.ssociatcd with at 
least two audio channels driven by an audio processing 
component (not shown) in box 16. More than two speakers 
and two audio channels, e.g., four, may also provided and 
those skilled in the art will readily appreciate that the sound 
effect concepts described below are readily extensible to 
more than two audio channels. Moreover, the speakers may 
alternalively be built into the box 16. 

Of ci»urse the personal computer illustrated in FIG. 4A is 
purely exemplary of one type of computer system in which 
graphical u.scr interfaces according to the present invention 
may be implemented. I'or example, although the display 
space 24 of the system depicted in FIG. 4 A coasisis of that 
provided by monitor 22, those skilled in the art will recog- 
nize thai additional display devices a)uld be arranged proxi- 
mate monitor 22 to create a display space bridging .several 
monitors, llie circuit boards included in box 16 can include 
boards which acoom modal e functional units such as those 
illustrated by the block diagram of FIG, 4H, 'Hicrein RAM 
3(K), ROM 320, processor 340, and I/O 360 (including 
sound/audio processing functionality) arc all inierconnecled 
via system bus 380. 

The computer system can also have known 1/0 devices 
(e.g.^ CI) drives, lloppy di.sk drives, hju'd drives, etc.) which 
can .store and read programs and data structures used to 
implement the bclow-dcscribcd techniques. These programs 
and data .structures can be encoded on .such computer- 
readable media. I'or example, the theme data files including 
sound effect information described below can be .stored on 
computer-readable media and read whenever a theme is 
selected for (JUI operation. 

According to exemplary embodiments of the present 
invention, sound effects a.s.sociated with the operation of 
GUI objects can be provided. 'Iliese sound effects can be 

50 specified for each theme, e.g.. as part of the data structure 
found in a theme data file, in a manner that is consi.stent with 
the appearance characteristics of that theme, e.g., the object 
geometries and fill patterns. A discission of themes and 
methods for handling themes is unneccss-iry for undersiand- 
ing the present invention, other than a general recoj;nition 
that a theme represents a predetermined definition of appear- 
ance and behavior attributes associated with GUI objects 
and that multiple themes having different definitions can be 
provided to a sy.slem wherein the underlying functions of the 
CJUI t)bjects remains the same. However, the interested 
reader is referred lo the above-idenlified applications or lo 
U.S. patent applieition Scr No. (WA)74,S19, entitled "A 
Multiple Theme Unginc Graphical User Interface 
Architecture", filed on the same date as this application, the 

(,5 disclosure of which is iacorpotated here by reference. 

Sound effects according to the present inventitm can be 
categorized as either one-shol .sounds or looped sounds. 
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One-shot sound cfVccls can be associated wilh stale changes 
in objccLs. State changes occur when an object Ls operated 
on, either by a user or by an application, to change its stale. 
e.g., checking a checkbox, depressing a button, opening and 
closing menus, opening and closing windows, emptying a s 
trash container, mounting a volume, etc. Stale tables can be 
used to store information identifying the transitional sound 
eirects between states that arc associated with particular 
operations on an object. An exemplary stale diagram table is 
shown as FIG. 5 which provides an example of possible jo 
stales and common slate transitions for a checkbox control 
eletnenl of a window, 'Hiis state diagram can then be reduced 
to a stale table as shown in 1-1 G. 6. 

As seen in h'IGS. 5 and 6, this exemplary checkbox 
control element has nine possible stales 01-O9 whicli can 
be displayed on the GUI. 'ITicsc states include three high- 
lighted di.splay slates for each of the control element's three 
values. I'or example, when a user clicks on an unchecked 
checkbox (stale Qi) using a mouse button, this action moves 
the control to its pressed stale (state Q4), After the mouse 
button is released, the control returns back to its original 
state (.slate Ql) and the application is notified of the button 
which has been pres.sed. Hie application then switches the 
value of the control to its new value, which might be 
checked (state 02). 

I'lG, 6 is a matrix of all of the possible transitioas between 
slates 01 and Q9. Transition sound clTects are indicated for 
some orihe,se transitions by the notations Tl-'!'l8 found in 
some of the matrix locations. Tor example, transition eflect 
Tl occurs when an empty checkl)ox (stale 01) becomes 
checked (slate 02). Hiis elTect a)uld be, for example, a 
onc-shol clicking noise that has been predefnicd by the 
theme file for this particular transition output through speak- 
ers 26 and 28. Other themes may use other sound effects, or 
no sound elVecl, for the same transition TV. Note that not all 
of the slate transitions are required to have transition effects 
as underscored by the empty matrix locatioas in FIG. 6. 

In adciiti(Hi to specifying a particular one- shot sound to be 
otitpiM as a sound effect for a partic\jlar transition, the 
present invention also provides the theme de.signcr with 
techniques for re-using or adjusting the recorded ,sound. For 
example, the data .structure which defines the .sound effect 
lor a parlicular state transition may include variables asso- 
ciated with the gain (volume), delay O^^notl beginning when 
a stale change occurs and ending when Ihc output of the 
sound effect begin.s) and pilch to (k used when oulputling 
the identified stiund for a particular object transition. ITius, 
Ihe same recorded sound effect could be re-used for different 
state iraiisitioiis liy varying one or more of tliese output 
parainclcis. Piis tecliiiique also pcnniLs the theme designer 
to make small adjustmetiLs in a recorded .sound eflect with- 
out actual ly re- recording the effect. 

One -.shot sound effects as.sociated with stale changes arc 
phtyetl asynchronously until complete, e.g., depressing a 
liution may result in a t)ne-shot sound effect that ends when 
the button is displayed in its fully sunk position. IJy way of 
contrast, movement of objects across the desktop can be 
accompanied by a looping sound cfTect designed to promote 
auditory perception oi' movement. I'he.se sound effects are 
"looping" in the seasc that cert.iin sound segments are 
repeated to accommodate the variable length nature of these 
effects. 

Ijoopiiig sound effects according to the picseiit inveiilion 
will be tie.scrilied herein by way of examples which involve 
dragj'iiig objects across the (lUI. e.g., dragging a .scroll liar 
imiicator, a slider, a window or an icon, although those 
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skilled in the art will appreciate that looping sound effects 
can be used for other object operatioas, e.g., resizing of 
objects. Consider the exemplary folder in I-IG. 7 being 
dragged from the position indicated by the solid outline of 
the folder to the position indicated by the dotted outline. 
When a ascr initiates the drag operation, e.g., by holding 
down a mou.se button while the cursor is positioned over the 
folder and beginning to move the mouse, the drag sound (for 
the currently selected theme) will begin and will continue 
until the drag operation is completed. 'Vhus, unlike the 
one-shot sound effects associated wilh stale changes which 
each have a fixed duration, drag sound effects have a 
variable duration dependent upon the length of the object 
movcmcnl period. This is accomplished by repealing, or 
looping, certain sound segments associated wilh this sound 
effect. 

Exemplary embodiments of tlic present invention divide 
drag .sounds into three segments: an attack segment, a 
sustain .segment and a decay segment. Each of these seg- 
ments can be recorded .separately and identified individually 
in the loaded theme data lile or in the code which runs the 
theme. 'Ilic attack segment is played first to initiate the drag 
operation, e.g., when the user begins to move folder A. Then, 
the sustain segment is repeated while the drag operation 
continues, e.g,. while the folder is moving across the screen 
from its original position to its new position. Once the drag 
operation terminates, the decay segment is played to gradu- 
ally transition out the sound effect associated with this drag 
operation, e.g, when the user rclca.scs the mouse button after 
the folder A is in the position indicated by the dolled outline 
in FIG. 7. As with the onc-shol sound effects, the looping 
.sound effects can also be adjustal by gain, delay and pitch 
variables which can be individually established for each 
effect. 

Although described separately here, those skilled in Ihe 
art will appreciate that one-shot .sounds can be reproduced 
while a looping .sound effect is being played. I'or example, 
if a document icon is dragged across the screen, a corre- 
.sponding looping sound effect will be played. If the docu- 
ment icon Ls dropped onto a u)ntainer, such as a folder or a 
trash can, the slate change associated with the placement of 
the document into the container may trigger a one-shot 
sound which may play at the same time a.s, for example, Ihe 
decay segment of Ihc looping sound effect associated with 
Ihe drag operation, lliese, and other, exemplary coordina- 
tions between one -.shot and looping sound effects arc illus- 
trated in I'IG. 6 A. 

To further enhance the user's perception of the position of 
an object on the .screen or that the object is moving, the 
one-shot .stiund effects can be output with a volume variation 
between S|x;akers 26 and 2K, and Ihc looping .stiund effect 
can he actively panned between .speakers 26 and 28. This is 
accomplished by steret) mixing of tlie sound effect between 
the speakers ba.sed on the ohj eel's po.sition on the .screen to 
achieve an auditory effect which implies location or move- 
ment. I'\)r the one-shot .sound effect, this simply involves 
playing the sound effect at a fixed, but different volume from 
each speaker (unle.ss the object that is changing .states is in 
the middle of the .screen). For looping sound effects, active 
panning changes the volume of the sound effect in each 
channel ba.sed on the cursor position. In the example of I'IG. 
rid 7, the sound effect wouU! begin, i.e., wilh the attack .segment, 
being more loudly output from speaker 26 ttian speaker 2H 
(FIG. 4 A). As the folder is dragged acro.ss the screen (he 
luudi»ess ratio between speaker 26 and speaker 2H would 
gradually .shift to being uiuglily eipial near the middle of the 
screen and, ullimalely, to being output mure loudly from 
speaker 2K as the fokler ncared I lie position indicatal by the 
dotted outline. 
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AppHcanis have discovered that the realism of the pan- 
ning ctrccl can be optimized by mixing the sound cn'ccl 
between the two channels as illustrated in l*IG. H. 'ITierein. 
the panning relatioaship is plotted as a function of sound 
eflfect volume (without taking into account any modifica- s 
tions made to the volume by virtue of the gain parameter 
spec ill ed in the data structure for this sound ellect) versus 
screen position of the dragged o!)jccl. It will be seen that the 
volume will vary hetwccn a minimum of about 50% of its 
recordetl value to a maximum of about 150% of its recorded 
value (excluding gain variations). If a gain value is specified 
for the sound effect for a particular Uicmc, then the gain 
value is multiplied by the illustrated percentage of recorded 
volume, for each channel, (o determine an appropriate 
output volume for the object at its current position. As 
mentioned above, this aspect of the present invention can 
readily be extended to provide for active panning in more 
than two directions, e.g. four, by providing four speakers and 
audio channels. 

According to other exemplary enii)odimenLs of the present 
invention, frequency variation can be introduced to provide 
some auditory variety in both the one-.shot and looping 
sound eHects. I'or example, each time that a sound effect is 
called in response to a .state change or object movement, the 
corresponding sound efi'ect can be played at a frequency that 
is pseudo-randomly selected. 'Hie frequency for playback 
can be selected from within a frequency envelope centered 
at the originally recorded frequency and having, for 
example, a width of plus or minus ahout 2.5 percent. Hy 
changing the frequency slightly from repetition to repetition. 3^ 
exemplary embodiments of the present invention avoid u.ser 
fatigue with respect to the sound effects and prtMoote enable- 
ment of this functionality. 

At the same lime, however, a certain amount of consis- 
tency in the frequency of each sound effect is desirable to 35 
preserve the auditory effect intended by the theme designer 
and to allow the user to easily associate the sound effect with 
the corresponding slate change or object movement. Thus, 
according to one exemplary embodiment of the present 
invention, selection oj a frequency from within the envelope 40 
is weighted .such thai frequencies closer to the originally 
recordeti frequency are more likely to he selected than 
frequencies toward the edges of the envelope. I'or example, 
a suitable weighting function is illustrated in FIG. 9. 
Hierein, a random number is generated within an interval 45 
between plus ami minus one and each value has a corre- 
sponding frequency variation a.s.sociated therewith. It can be 
.seen in the l-igure that the curve is weighted .such that fully 
half t)f the randomly .selected frequency v aria tions a re within 
itne quarter tif the total envelope in this exemplary weight- 5,) 
iiig. 

Various controls can be put into place lo provide for an 
orderly presentation of sound elTecLs. l-or example, sound 
elVecl commands may he temporarily (wcrritldcn t(» avoid an 
avalanche of effects, e.g., when clo.sing or opening many 
windows at the same time. Similarly, lirag .sound effects can 
be limited to one at a time to provide for a consistent 
auditory experience. 

Sound ellecLs can be chLssilied in one of a plurality of 
eliect levels. In this way, a .sound control panel can be 00 
provided in the GUI which allows a u.ser to select from more 
sound lo less sound at which .she or he would prefer to 
operate the interface at any given time. AUernatively, or in 
addition (hereto, sounds may al.so he enai)led or disabled by 
a u.ser hy functional categor)'. l-or example, .sound efVecls 05 
may be enabled itr di.sabled for all windows, all menus, all 
icttns of a certain type. etc. 
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The above-described exemplary embodiments arc 
intended to be illu.slrative in all respects, rather than 
restrictive, of the present invention. 'Hi us the present inven- 
tion is capable of many variations in detailed implementa- 
tion that c<m be derived from the description contained 
herein by a person skilled in the art. All such variations and 
modifications are considered to be within the scope and 
spirit of the present invention as defined by the following 
claims. 

What is claimed is: 

1. A method for providing a sound effect between a first 
display position associated with an object drawn on a 
graphical user interface of a computer system and a second 
display position associated with said object, the method 
comprising the steps of: 

drawing said object in said first display position of a 
display space controlled by said graphical user inter- 
fat^e; 

receiving, at said graphical user interface, a user input 
invoking movement of said object; 

retrieving a sustain sound segment; and 

repeatedly reproducing said sustain sound .segment until 
said graphical user interface receives a second u.ser 
input indicating that said object has reached said sec- 
ond display pasilion. 

2. The method of claim 1, further comprising the step of: 
panning said reproduced sustain sound segment between 

speakers as said object moves from said first display 
position to said second di.splay pasition. 

3. The method of claim 2, wherein said step of panning 
further comprises the steps of: 

varying a volume between said speakers between 50 and 
150 percent of a recorded volume depending upon a 
current display position. 

4. 'Hie method of claim 1, wherein said step of reproduc- 
ing further comprises the step of; 

reproducing said .sastain sound segment at a volume 
specified for movement i)f said oliject. 

5. The method of claim I, wherein .said .step of reprttduc- 
ing further compri.ses the step of: 

reproducing .said sustain sound segment at a pilch speci- 
fied for movement of said object, 

6. The method of claim 1, wherein said step of reproduc- 
ing further comprises the .step of: 

reproducing .said sastain sound segment after a delay 
specified for movement of said object. 

7. 'llie method of claim 1, further comprising the step of; 
retrieving, prior to relrieving said su.stain sound segment, 

an attack sound sttgment thai is reprodncexl prior lo 
repeatedly reproducing said sustain sound segment. 

K. The method of claim 1, further comprising tlie step of; 

retrieving and reproducing, after said second u.ser input is 
received, a decay sound segment. 

9. The melhod of claim I, furl her comprising the step of; 

selecting, from within a range of frequencies, a frequency 
for repeatedly reproducing said sustain .sound .segment. 

H). Hie method of claim 9, wherein said .step of .selecting 
furtlier compri.ses the .step of: 

setting said range of frecjuencies let an envelope of about 
plus/minus 2.5 percent of an original frequency at 
which sail! su.stain stiund segment was recorded. 

1 1 . Hie method of claim 10. wherein sa id .step of selecting 
further compri.ses the step of weighting select it)n of said 
Irequeiicy from within said envelope. 

12. Ilie method of claim I, wherein the .sustain .sound 
segment is relrievcd in rcspon.se to said user ifiput invoking 
movement of said object. 
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13. In a compuicr having a display, a system for providing 
a sound effect between a first and a second display position 
of an ohjcct on said display, said system comprising: 

an input device for controlling movcmeni of a cursor on 
said display and for generating a user-controlled output ^ 
when said cursor is positioned over a control element; 

a graphical user interface for rendering said object on said 
display in said first display position and for receiving 
said user-controlled output; and 

a storage device for storing said sound effect associated 
with movement of said object, wherein when said 
graphical user interface receives said user-controlled 
outpul, said graphical user inlcrfacc outputs said sound 
effect until said object reaches said second display 
posilion. 

14. The system of claim 13, further comprising: 

at least two speakers for outputting said sound effect; and 
means for panning said sound effect between speakers as 

said object moves from said first dl'iplay position to 20 

said second display position. 

15. The system of claim 14, wherein said means for 
panning further comprises: 

means for varying a volume between said speakers 
between 50 and 150 percent of a recorded volume 
tiepeiiding upon a current display posilion. 

16. The system of claim 13, wherein a data structure 
a.*iS(idaled with said sftund effect includes a volume param- 
eter specified for output of said sound effect. 

17. 'Pic system of claim 13, wherein a data structure -^^ 
associated with said sound effect includes a pitch parameter 
.specified for output of said sound effect. 

18. The system of claim 13, wherein a data structure 
as.sociated with said sound effect includes a volume gain 
parameter spccifiul for output of said sound effect. 



19. 'I'he system of claim 13, wherein a data structure 
associated with said sound effect includes an attack segment, 
a sustain segment and a decay segment. 

20. 'Vhc system of claim 19, further comprising: 

means for retrieving, prior to retrieving said sustain sound 
segment, said attack sound segment that is reproduced 
prior to repeatedly reproducing said sustain sound 
segment. 

21. 1lie system of claim 20, wherein said means for 
retrieving further comprises: 

meaas for retrieving and reproducing, after said second 
display position is reached, said decay sound segment. 

22. ITic system of claim 13, further comprising: 
means for selecting, from within a range of frequencies, 

a frequency for repeatedly reproducing said sound 
effect. 

23. The system of claim 22, wherein said means for 
selecting further comprises: 

means for setting said range of frequencies to an envelope 
of about plus/minus 2.5 percent of an original fre- 
quency at which said sound effect was recorded. 

24. The system of claim 23, wherein said means for 
selecting further a)mprises: 

means for weighting selection of said frequency from 
within said envelope. 

25. The system of claim 13, further comprising: 
means for initiating said .';ound effect oulputled by .said 

graphical user interface in response to the movement of 
said object. 
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